Display method and video recording method

ABSTRACT

Provided are a display method and a video recording method for a user to perceive a position of an extraction range moving within an angle of view, wherein the display method includes an acquisition step of acquiring a reference video that is a motion picture, an extraction step of extracting an extraction video set to be smaller than an angle of view of the reference video within the angle of view from the reference video, a movement step of moving an extraction range of the extraction video over time, a first display step of displaying the extraction video on a display device, and a second display step of displaying a support video based on a positional relationship between the angle of view and the extraction range on the display device, in which the second display step is executed during execution of the first display step.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a Continuation of copending application Ser. No.17/704,416, filed on Mar. 25, 2022, which is a Continuation of PCTInternational Application No. PCT/JP2020/028347, filed on Jul. 22, 2020,which claims the benefit under 35 U.S.C. § 119(a) to Patent ApplicationNo. 2019-176631, filed in Japan on Sep. 27, 2019, all of which arehereby expressly incorporated by reference into the present application.

BACKGROUND OF THE INVENTION 1. Field of the Invention

The present invention relates to a display method of displaying a videoand a video recording method of recording a video.

2. Description of the Related Art

Among imaging apparatuses capturing videos, there is an imagingapparatus that extracts (cuts out) a video of a part of an angle of viewof a captured video and displays the extraction video, such as imagingapparatuses disclosed in JP2017-46355A and JP2019-22026A.

The imaging apparatuses disclosed in JP2017-46355A and JP2019-22026Ahave a function of changing a position or the like of an extractionregion within the angle of view at a predetermined speed. In a casewhere this function is used, for example, it is possible to track asubject in the video or cause an angle of a recorded video to slide in acertain direction without manually operating the imaging apparatusesduring imaging.

SUMMARY OF THE INVENTION

In a case of displaying a video within an extraction range while movingthe extraction range, it is required that a position of the extractionrange within the angle of view can be checked so that a user canperceive which range within the angle of view is extracted.

However, in a display method of a video using the imaging apparatusesdisclosed in JP2017-46355A and JP2019-22026A, while the video within theextraction range moving within the angle of view is displayed, it isdifficult to perceive the position of the extraction range from only thedisplayed video.

The present invention is conceived in view of the above matter, and anobject thereof is to resolve problems of the technology in the relatedart and provide a display method for causing a user to perceive aposition of an extraction range moving within an angle of view, and avideo recording method employing the display method.

In order to accomplish the above object, a display method according toan aspect of the present invention comprises an acquisition step ofacquiring a reference video, an extraction step of extracting anextraction video set to be smaller than an angle of view of thereference video within the angle of view from the reference video, amovement step of moving an extraction range of the extraction video overtime, a first display step of displaying the extraction video on adisplay device, and a second display step of displaying a support videobased on a positional relationship between the angle of view and theextraction range on the display device, in which the second display stepis executed during execution of the first display step.

According to the display method according to the aspect of the presentinvention, by displaying the support video based on the positionalrelationship between the angle of view and the extraction range duringdisplay of the extraction video, a user can perceive a position of theextraction range moving within the angle of view.

In addition, in the display method according to the aspect of thepresent invention, the support video may include the extraction video,and in the second display step, the support video in which a position ofthe extraction video in the support video is specified may be displayed.

In addition, the display method according to the aspect of the presentinvention may further comprise a third display step of displayinginformation related to at least one of the reference video or theextraction video on the display device. In this case, it is morepreferable that the third display step is executed during execution ofboth of the first display step and the second display step.

In addition, in the display method according to the aspect of thepresent invention, in the first display step, the extraction video maybe displayed in a state where a display size of the extraction video ischangeable, and in the second display step, the support video may bedisplayed in a state where an aspect ratio of the support video and adisplay size of the support video are changeable.

In this case, in the first display step, the extraction video may bedisplayed in a state where the display size of the extraction video ischangeable while an aspect ratio of the extraction video is constantlymaintained, and in the second display step, the support video may bedisplayed in a state where the display size of the support video ischanged in accordance with a change in display size of the extractionvideo.

Alternatively, in the display method, in the second display step, thesupport video indicating a video of a part of the reference video may bedisplayed in a state where the display size of the support video ischanged while the aspect ratio of the support video is constantlymaintained, in accordance with a change in display size of theextraction video.

In addition, in the display method according to the aspect of thepresent invention, the second display step may be executed in accordancewith a display scheme selected by a user from a first display scheme anda second display scheme, in a case where the first display scheme isselected, in the second display step, the support video may be displayedin a state where an aspect ratio of the support video and a display sizeof the support video are changeable, and in a case where the seconddisplay scheme is selected, in the second display step, the supportvideo indicating a video of a part of the reference video may bedisplayed in a state where the display size of the support video ischangeable while the aspect ratio of the support video is constantlymaintained.

In addition, the acquisition step may be an imaging step of capturingthe reference video within the angle of view. In this case, in theimaging step, the reference video may be captured within the angle ofview using an anamorphic lens, and in the first display step, theextraction video may be displayed by extending a size in a lateraldirection of the angle of view using the anamorphic lens.

In addition, in the display method according to the aspect of thepresent invention, the movement step may be executed during execution ofthe imaging step, and in the movement step, at least one of a position,a size, a movement speed, or a movement direction of the extractionrange may be changed based on an instruction of a user received duringexecution of the movement step.

In addition, in the display method according to the aspect of thepresent invention, in the movement step, the extraction range may bemoved within the angle of view such that a subject of a tracking targetset by a user enters within the extraction range.

In addition, the display device may include a first display device and asecond display device that are devices separated from each other. Inthis case, the first display device may display the extraction video onthe first display device, and the second display device may display thesupport video on the second display device.

In addition, the display method according to the aspect of the presentinvention may further comprise a third display step of displaying textinformation related to at least one of the reference video or theextraction video on the second display device. In this case, the thirddisplay step may be executed during execution of both of the firstdisplay step and the second display step, and in a case where a widthand a height of the first display device are inverted during the firstdisplay step, the support video of which a width and a height areinverted may be displayed on the second display device in the seconddisplay step, and the text information of which a display orientation ismaintained may be displayed on the second display device in the thirddisplay step.

In addition, the display method according to the aspect of the presentinvention may further comprise a determination step of determiningwhether or not a distance between an end of the angle of view and an endof the extraction range is less than a threshold value during executionof the movement step, and an alert step of issuing an alert to a user ina case where the distance is less than the threshold value.

In addition, according to an aspect of the present invention, it ispossible to provide a video recording method employing the displaymethod, the video recording method comprising a recording step ofrecording the extraction video on a recording medium.

In addition, the present invention provides an apparatus for videodisplay including a processor configured to execute an acquisition stepof acquiring a reference video, an extraction step of extracting anextraction video set to be smaller than an angle of view of thereference video within the angle of view from the reference video, amovement step of moving an extraction range of the extraction video overtime, a first display step of displaying the extraction video on adisplay device, and a second display step of displaying a support videobased on a positional relationship between the angle of view and theextraction range on the display device, in which the second display stepis executed during execution of the first display step.

According to the display method and the video recording method accordingto the aspects of the present invention, the user can perceive theposition of the extraction range moving within the angle of view.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram of an exterior of an imaging apparatus used in adisplay method according to a first embodiment of the present inventionin a view from a front surface side.

FIG. 2 is a diagram of the exterior of the imaging apparatus used in thedisplay method according to the first embodiment of the presentinvention in a view from a rear surface side.

FIG. 3 is a diagram illustrating a configuration of an imaging apparatusmain body comprised in the imaging apparatus used in the display methodaccording to the first embodiment of the present invention.

FIG. 4 is a diagram illustrating a screen example displayed on a displaydevice during imaging in the first embodiment of the present invention.

FIG. 5 is a descriptive diagram for an extraction video.

FIG. 6 is a diagram illustrating an extraction mode selection screen.

FIG. 7 is a diagram illustrating a movement path of an extraction rangein a tracking mode.

FIG. 8 is a diagram illustrating the movement path of the extractionrange in a panning mode.

FIG. 9 is a descriptive diagram for a support video.

FIG. 10 is a descriptive diagram for information such as settingcontents.

FIG. 11 is a diagram illustrating a processing flow related to thedisplay method according to the first embodiment of the presentinvention (Part 1).

FIG. 12 is a diagram illustrating the processing flow related to thedisplay method according to the first embodiment of the presentinvention (Part 2).

FIG. 13 is a diagram illustrating a screen example of a display deviceaccording to a second embodiment of the present invention (Part 1).

FIG. 14 is a diagram illustrating a screen example of the display deviceaccording to the second embodiment of the present invention (Part 2).

FIG. 15 is a diagram illustrating a display scheme selection screen.

FIG. 16 is a diagram illustrating a configuration of an imaging systemused in a display method according to a third embodiment of the presentinvention.

FIG. 17 is a diagram illustrating a screen example of a display deviceaccording to the third embodiment of the present invention.

FIG. 18 is a diagram illustrating a screen example of the display deviceaccording to the third embodiment of the present invention in a casewhere a width and a height of the imaging apparatus are inverted.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

Hereinafter, preferred embodiments (a first embodiment to a fourthembodiment) of the present invention will be described in detail withreference to the appended drawings. The embodiments described below aremerely an example for facilitating understanding of the presentinvention and do not limit the present invention. That is, the presentinvention may be changed or improved from the embodiments describedbelow without departing from a gist thereof. In addition, the presentinvention includes equivalents thereof.

First Embodiment

The first embodiment of the present invention relates to a displaymethod using an imaging apparatus 10 illustrated in FIGS. 1 and 2 . Thatis, the display method according to the first embodiment of the presentinvention is implemented by the imaging apparatus 10.

[Basic Configuration of Imaging Apparatus]

A basic configuration of the imaging apparatus 10 will be described withreference to FIGS. 1 to 3 .

The imaging apparatus 10 is a portable digital camera, has an exteriorillustrated in FIGS. 1 and 2 , and captures a still picture and a motionpicture. In addition, the imaging apparatus 10 has functions ofdisplaying a captured image (video) and recording the video. In thepresent specification, a function of capturing a video that is a motionpicture in real time will be mainly described among functions of theimaging apparatus 10.

The imaging apparatus 10 is configured with an imaging apparatus mainbody 12 and a housing 14. The imaging apparatus main body 12 is a partof the imaging apparatus 10 excluding the housing 14. The housing 14 hasapproximately the same structure as a housing of a general digitalcamera and accommodates an imaging portion 20 and a control portion andthe like including a controller 30 and a video processing portion 32illustrated in FIG. 3 .

The imaging portion 20 is a device capturing a video and includes a lensunit 110, a lens drive portion 120, a stop portion 130, a shutter 140,an imaging sensor 150, and an analog/digital (A/D) converter 160 asillustrated in FIG. 3 .

The lens unit 110 includes a zoom lens 112 and a focus lens 114. In thefirst embodiment, the zoom lens 112 is equipped with an anamorphic lens.Thus, in the first embodiment, the video can be captured within an angleof view (for example, an angle of view having an aspect ratio of 2.35:1)that is wide in a lateral direction. The present invention is notlimited to the anamorphic lens, and imaging lenses such as a wide anglelens, an ultra wide angle lens, and a 360-degree lens may be used. Inaddition, the lens unit 110 may be configured to be interchangeable withother lens units. In addition, the imaging portion 20 may comprise aplurality of lens units 110 having angles of view different from eachother.

Here, the angle of view in capturing the video using the imaging portion20 is decided in accordance with specifications and the like of the lensunit 110 and the imaging sensor 150, and the video captured within theangle of view corresponds to a “reference video” according to theembodiments of the present invention. An aspect ratio of the referencevideo is a value corresponding to the angle of view and is, for example,2.35:1 in a case where the anamorphic lens is used.

The lens drive portion 120 is configured with a drive motor, notillustrated, and a drive mechanism, not illustrated, and moves thelenses of the lens unit 110 along an optical axis.

The stop portion 130 adjusts a size of an opening portion in accordancewith setting of a user or automatically, and adjusts a quantity of lightpassing through the opening portion.

The shutter 140 blocks light transmitted to the imaging sensor 150.

The imaging sensor 150 is configured with, for example, a chargedcoupled device (CCD) or a complementary metal oxide semiconductor imagesensor (CMOS), forms an image by receiving light from a subject throughthe lens unit 110, and generates image data. Specifically, the imagingsensor 150 converts a light signal received through a color filter intoan electric signal using a light-receiving element, amplifies theelectric signal using an auto gain controller (AGC), and generatesanalog image data from the signal after amplification.

The A/D converter 160 converts the analog image data generated by theimaging sensor 150 into digital image data. The digital image datacorresponds to data of a frame image constituting the reference videothat is a motion picture.

The number of pieces of pixel data (that is, the number of pixels)constituting the digital image data is not particularly limited. In thefirst embodiment, the number of pixels is greater than or equal to 10million. Preferably, a lower limit of the number of pixels may begreater than or equal to 60 million. In addition, a preferred upperlimit of the number of pixels in the first embodiment is less than orequal to 1 billion and more preferably less than or equal to 5 billion.In a case where the number of pixels is above the lower limit,visibility of an extraction video extracted from the reference video canbe secured. In addition, in a case where the number of pixels is belowthe upper limit, a pixel information amount of the reference video canbe further decreased. Thus, a speed of processing performed by thecontrol portion (specifically, the video processing portion 32) isincreased.

The controller 30 controls each portion of the imaging apparatus mainbody 12 in accordance with an operation of the user or automatically,and, for example, can cause the imaging portion 20 to capture (acquire)the reference video by controlling the imaging portion 20. In addition,the controller 30 can control the video processing portion 32 such thata video (specifically, the extraction video described later) is recordedon a recording medium. In addition, based on a contrast or the like ofthe entire or a part of an image indicated by the digital image datagenerated by the imaging portion 20, the controller 30 can control thelens drive portion 120 to set a focal point of the lens unit 110 tofocus on the subject in the image. In addition, based on brightness ofthe entire or a part of the image indicated by the digital image datagenerated by the imaging portion 20, the controller 30 can control thestop portion 130 and automatically adjust an exposure amount at a timeof imaging. In addition, the controller 30 can control the lens driveportion 120 to perform zooming (optical zooming) in accordance with theoperation of the user or automatically in accordance with a distancebetween the subject and the imaging apparatus 10.

The video processing portion 32, under control of the controller 30,performs processing such as gamma correction, white balance correction,and defect correction on the digital image data generated by the imagingportion 20 and furthermore, compresses the processed digital image datain a compression format complying with a predetermined standard. Thevideo processing portion 32 acquires the reference video from thecompressed digital image data that is sequentially generated duringimaging, and executes various processing on the acquired referencevideo. As an example of processing performed on the reference video, thevideo processing portion 32 can extract the extraction video (so-calledcropped image) that is smaller than the angle of view within the angleof view of the imaging portion 20 from the reference video. In addition,the video processing portion 32 can change a size of a range(hereinafter, referred to as an extraction range) of the extractionvideo in order to perform zooming (electronic zooming) on a video of thesubject within the extraction video. Here, the size of the extractionrange is the number of pixels of the extraction video (in a strictsense, the number of pixels in each of a width and a height of theextraction video).

The control portion including the controller 30 and the video processingportion 32 consists of one or a plurality of microcontrollers orprocessors. Specifically, for example, the control portion is configuredwith a central processing unit (CPU) and a control program causing theCPU to execute various processing. The present invention is not limitedthereto. The processor may be configured with a field programmable gatearray (FPGA), a digital signal processor (DSP), an application specificintegrated circuit (ASIC), a graphics processing unit (GPU), amicro-processing unit (MPU), or other integrated circuits (ICs), or maybe configured with a combination thereof. In addition, as represented bya system on chip (SoC) or the like, the processor may be such thatfunctions of the entire control portion including the controller 30 andthe video processing portion 32 are configured with one integratedcircuit (IC) chip. Furthermore, a hardware configuration of eachprocessor above may be implemented by an electric circuit (circuitry) inwhich circuit elements such as semiconductor elements are combined.

The housing 14 further accommodates an internal memory 230 incorporatedin the imaging apparatus main body 12, a memory card 240 that isattachable to and detachable from the imaging apparatus main body 12through a card slot 260, and a buffer 250. The internal memory 230 andthe memory card 240 are the recording medium on which the extractionvideo is recorded, and are configured with a flash memory, aferroelectric memory, and the like. The buffer 250 functions as a workmemory of the controller 30 and the video processing portion 32 and isconfigured with, for example, a dynamic random access memory (DRAM) or aferroelectric memory. In addition, the buffer 250 stores various settingcontents, imaging conditions, and the like.

The recording medium does not need to be disposed inside the imagingapparatus main body 12 and may be an external recording medium connectedto the imaging apparatus main body 12 via the Internet. In addition, therecording medium may be connected to the imaging apparatus main body 12through a cable such as a universal serial bus (USB) cable or aHigh-Definition Multimedia Interface (HDMI) (registered trademark), orwirelessly.

A display device 40 is attached to a rear surface of the housing 14 asillustrated in FIG. 2 . The display device 40 is configured with aliquid crystal display (LCD), an organic electroluminescence (EL)display, a light emitting diode (LED) display, an electronic paper, orthe like. The display device 40 displays various videos including theextraction video and also displays an operation screen for setting ofthe imaging conditions and the like and mode selection.

In the first embodiment, an aspect ratio of a screen of the displaydevice 40 is different from the aspect ratio of the angle of view andis, for example, 4:3 or 16:9. The screen of the display device 40 has asmaller value corresponding to a width/height than the angle of view.

The housing 14 comprises an operating part 50. The user performs variousoperations related to imaging through the operating part 50. Forexample, as illustrated in FIGS. 1 and 2 , the operating part 50includes a release button 310, a zoom lever 320, a front operation dial330, a rear operation dial 340, a cross button 350, and a touch wheel360 arranged on the housing 14. In a case where these devices areoperated by the user, the devices transmit various control signalstoward the controller 30. For example, in a case where the zoom lever320 is operated, a control signal for changing a zoom magnification istransmitted toward the controller 30 in accordance with the operation.The controller 30 controls the lens drive portion 120 in order to movethe zoom lens 112 in accordance with the control signal.

In addition, in the first embodiment, the display device 40 is a touchpanel display and doubles as the operating part 50. In a case where theuser touches the screen of the display device 40, a control signalcorresponding to the touched position is transmitted toward thecontroller 30. For example, an extraction mode selection screen (referto FIG. 6 ) described later is displayed on the display device 40. Theuser selects one of a plurality of modes and touches one correspondingbutton of a plurality of mode selection buttons drawn on the screen.Consequently, a control signal for setting the selected mode istransmitted toward the controller 30. The user can instruct the controlportion to perform zooming processing or shutter processing (imagingprocessing) by touching the screen of the display device 40.

[Screen Example of Display Device during Imaging]

Next, a screen example displayed on the display device 40 during imagingin the first embodiment will be described with reference to FIG. 4 .

In the first embodiment, the screen of the display device 40 is dividedinto three regions during imaging. As illustrated in FIG. 4 , anextraction video P1, a support video P2, and information IF such as thesetting contents are displayed in a first region, a second region, and athird region, respectively, at the same time.

Hereinafter, each of the extraction video P1, the support video P2, andthe information IF such as the setting contents will be described indetail.

(Extraction Video)

As illustrated in FIG. 5 , the extraction video P1 is a video that isset to be smaller than an angle of view A0 of a reference video P0within the angle of view A0, and is extracted (cut out) from thereference video P0.

In the first embodiment, the reference video P0 is a high image qualityvideo consisting of 10 million or more (preferably, 60 million or more)pixels. Thus, the extraction video P1 extracted from the reference videoP0 is also a video having sufficiently high image quality.

In the first embodiment, outer edges of the extraction video P1 have anoblong shape. However, the shape of the outer edges of the extractionvideo P1 is not particularly limited and may be a square shape, aparallelogramic shape, a trapezoidal shape, a rhombic shape, a circularshape or an elliptical shape, a triangular shape or a polygonal shape ofa pentagonal or higher-faceted shape, or an indefinite shape.

The extraction video P1 is extracted from the reference video P0 by thevideo processing portion 32 as needed during imaging and is displayed inthe first region on the screen of the display device 40 by the videoprocessing portion 32. At this point, the extraction video P1 isdisplayed in a state where a display size can be changed to fall withinthe first region while the aspect ratio is maintained. In a case ofperforming imaging using the anamorphic lens, the extraction video P1 isdisplayed by extending the size in a lateral direction of the angle ofview A0 in a case of using the anamorphic lens. A reason for doing so isbecause an image size is temporarily compressed in the lateral directionof the angle of view A0 at a point in time of image forming by theimaging sensor 150, and the display size is to be restored to anoriginal size in a case of displaying the extraction video P1.

In the screen example illustrated in FIG. 4 , the extraction video P1 isdisplayed in a region positioned lowest on the screen of the displaydevice 40. However, the present invention is not limited thereto. Forexample, the extraction video P1 may be displayed in a region positionedon the uppermost side or a region at the center on the screen of thedisplay device 40.

In addition, during imaging, a range of the extraction video P1 withinthe angle of view A0, that is, an extraction range A1, can be moved overtime within the angle of view A0. Here, “moving over time” means movingthe extraction range A1 relative to the angle of view A0 such that aposition of the extraction range A1 gradually changes, and may include acase where movement is stopped (paused) in the middle of imaging.

Movement of the extraction range A1 over time is implemented by thevideo processing portion 32. Specifically, in a case where the userselects one mode through the extraction mode selection screenillustrated in FIG. 6 , the video processing portion 32 moves theextraction range A1 within the angle of view A0 along a movement pathcorresponding to the selected mode.

More specifically, in the first embodiment, two types of extractionmodes are prepared. One mode is a mode (hereinafter, referred to as atracking mode) in which the extraction range A1 is moved to track asubject of a tracking target. The other mode is a mode (hereinafter,referred to as a panning mode) in which the extraction range A1 is movedin a certain direction.

In a case where the tracking mode is selected, the video processingportion 32 moves the extraction range A1 to track the subject of thetracking target. In this procedure, in a case where the tracking mode isselected, the user designates the video of the subject within theextraction video P1 by, for example, touching on the screen. The videoprocessing portion 32 sets the subject designated by the user as thetracking target. Then, the video processing portion 32 moves theextraction range A1 such that the subject of the tracking target fallswithin the extraction range A1 as illustrated in FIG. 7 .

As described above, in a case where the tracking mode is selected, theextraction video P1 in which the subject of the tracking target iscaptured can be displayed on the display device 40 at all times as longas the subject of the tracking target is present within the angle ofview A0. In addition, the user does not need to move the imagingapparatus 10 in order to track the subject. Thus, the angle of view isnot manually changed, and distortion (blurred video or the like) of thevideo occurring due to manual changing of the angle of view can beavoided. This effect is particularly effective in a case of performingimaging within the angle of view using the anamorphic lens.

An algorithm for searching for the subject of the tracking target withinthe angle of view A0 is not particularly limited. For example, an imageof the subject set as the tracking target may be stored in the buffer250 as a template image, and the template image is compared with thereference video P0 by applying a well-known template matchingtechnology. As a result of comparison, a video of a part matching withthe template image may be specified as the video of the subject of thetracking target.

In a case where the panning mode is selected, the video processingportion 32 causes the extraction range A1 to slide, that is, pan, in acertain direction (for example, the lateral direction of the angle ofview A0). In this procedure, in a case where the panning mode isselected, the user sets a starting position, a movement direction, amovement speed, and the like of the extraction range A1 on a settingscreen not illustrated. Then, as illustrated in FIG. 8 , the videoprocessing portion 32 causes the extraction range A1 to automaticallypan in the set direction from the set starting position at the setspeed.

As described above, in a case where the panning mode is selected, avideo of which an imaging angle is continuously changed in a certaindirection, that is, a panoramic video, can be displayed on the displaydevice 40. In addition, the user does not need to move the imagingapparatus 10 in order to change the angle. Thus, the angle of view isnot manually changed, and distortion (blurred video or the like) of thevideo occurring due to manual changing of the angle of view can beavoided. This effect is particularly effective in a case of performingimaging within the angle of view using the anamorphic lens.

Setting items such as a size, an aspect ratio, an area ratio, and amovement speed during movement related to the extraction range A1 employinitially set contents. Alternatively, the user can set the settingitems to any contents on the setting screen not illustrated. The aspectratio of the extraction range A1 is an aspect ratio of the extractionvideo P1 and is, in a strict sense, a ratio of the number of pixels ineach of the width and the height. The area ratio of the extraction rangeA1 is a ratio of an area of the extraction range A1 to the angle of viewA0. In a case where the angle of view A0 is divided in units of pixels,the movement speed of the extraction range A1 is the number of pixelsthrough which the moving extraction range A1 passes within a unit timeperiod.

In addition, in the first embodiment, an instruction issued by the usercan be received through the operating part 50 during movement of theextraction range A1, and the size, the movement speed, the movementdirection, the position during movement, and the like of the extractionrange A1 can be changed based on the instruction. For example, the sizemay be changeable by operating the front operation dial 330, and themovement speed may be changeable by operating the rear operation dial340. In addition, the movement direction may be changeable by operatingthe cross button 350, and the position during movement may be changeableusing the touch panel of the display device 40. In this case, the usercan change various setting contents related to the extraction range A1intuitively in real time in accordance with a situation during movementof the extraction range A1.

Devices operated in a case of changing the setting contents of theextraction range A1 are not limited to the above correspondencerelationship. For example, the size of the extraction range A1 may bechanged based on an operation of the touch wheel 360.

(Support Video)

The support video P2 is a video based on a positional relationshipbetween the angle of view A0 and the extraction range A1 during imagingand is displayed in order for the user to perceive the position of theextraction range A1 within the angle of view A0 during imaging. Thesupport video P2 is displayed on the display device 40 by the videoprocessing portion 32. Specifically, the video processing portion 32recognizes the position, the size, and the like of the extraction rangeA1 during imaging, generates the support video P2 based on theseinformation, and displays the support video P2 on the display device 40.

In addition, the support video P2 is a video including the extractionvideo P1 as illustrated in FIG. 9 . In the first embodiment, the supportvideo P2 is configured with the entire reference video P0 (in a strictsense, the reference video P0 of which a display size is reduced whilean aspect ratio is maintained).

In addition, the support video P2 is a video in which a position of theextraction video P1 in the support video P2 is specified. Specifically,the support video P2 is a video in which the extraction video P1 issurrounded by a frame as illustrated in FIG. 9 .

An aspect of specifying the position of the extraction video P1 in thesupport video P2 may be an aspect other than an aspect of surroundingusing the frame. For example, an aspect of changing only a display colorof the extraction video P1 to a highlighted color in the support videoP2, or an aspect of displaying an instruction mark such as a cursor nearthe extraction video P1 in the support video P2 may be used. Inaddition, the extraction video P1 may be highlighted by setting adisplay color of a region other than the extraction video P1 in thesupport video P2 to be semi-transparent or to a gray color or the like.

In addition, in a case where the extraction range A1 moves duringimaging, the position of the extraction video P1 in the support video P2also changes in connection with the movement. In addition, in a casewhere the size, the aspect ratio, and the position of the extractionrange A1 change during movement, the size, the aspect ratio, and theposition of the extraction video P1 in the support video P2 also changein accordance with the setting contents after change.

The support video P2 described so far is generated by the videoprocessing portion 32 as needed during imaging based on the positionalrelationship between the angle of view A0 and the extraction range A1and is displayed in the second region on the screen of the displaydevice 40 by the video processing portion 32. At this point, the supportvideo P2 is displayed in a state where a display size can be changed tofall within the second region while the aspect ratio is constantlymaintained.

Here, in a case where a general lens is used, the support video P2 hasthe same aspect ratio as the reference video P0 (that is, the angle ofview A0). Meanwhile, in a case where imaging is performed using theanamorphic lens, the reference video P0 is changed to a laterally longvideo having an aspect ratio of 2.35:1 by extending the reference videoP0 in the lateral direction of the angle of view A0, and the referencevideo P0 is displayed on the display device 40 as the support video P2.An aspect ratio of a display screen of the display device 40 isgenerally different from an aspect ratio of the support video P2 (forexample, 4:3 or 16:9). Thus, in a case where the support video P2 isdisplayed on the display device 40, spaces (blanks) generally occur inlocations adjacent to the support video P2 in an up-down direction ofthe display screen. The extraction video P1 and the support video P2 canbe displayed in balance on the display device 40 at the same time usingthe spaces.

In the first embodiment, as illustrated in FIG. 4 , the support video P2is displayed at a position immediately above the extraction video P1.However, the present invention is not limited thereto, and the supportvideo P2 may be displayed below the extraction video P1.

(Information Such as Setting Contents)

The information IF such as the setting contents is information relatedto at least one of the reference video P0 or the extraction video P1. Inthe first embodiment, the information IF such as the setting contents istext information related to each of the reference video P0 and theextraction video P1.

The information IF such as the setting contents is displayed on thedisplay device 40 in cooperation between the controller 30 and the videoprocessing portion 32. Specifically, the controller 30 reads out thesetting contents, the imaging conditions, and the like from the buffer250, and the video processing portion 32 displays the information IFsuch as the setting contents on the display device 40 based on theinformation read out by the controller 30.

As illustrated in FIG. 10 , the information IF such as the settingcontents includes the setting contents (in FIG. 10 , contents belongingto a category referred to as “at time of setting”) for each of thereference video P0 and the extraction video P1, and information (in FIG.10 , information belonging to a category referred to as “at time ofimaging”) during imaging.

Information displayed as the information IF such as the setting contentsis not particularly limited. Examples of the information include theaspect ratio and the number of pixels of the extraction video P1, theposition and the area ratio of the extraction range A1, a movementdistance of the moving extraction range A1, a distance from an end ofthe extraction range A1 to an end of the angle of view A0, an estimatedtime period to when the moving extraction range A1 reaches the end ofthe angle of view A0, a setting operation method for the extractionrange A1, an imaging time period, various imaging conditions (forexample, an exposure condition, an f number of a lens, ISO sensitivity,and white balance), the number of pixels (4K, full high definition (HD),or the like) of the extraction region, and a frame rate at a time ofmotion picture capturing.

The position of the extraction range A1 is a representative position(for example, a center position or positions of four vertices) of theextraction range A1 and is represented as coordinates in a case where areference position (for example, a position of an upper left vertex ofthe angle of view A0) set in the angle of view A0 is an origin. For themovement distance of the moving extraction range A1, a total movementdistance of the extraction range A1 from a point in time of a start ofmovement is obtained in units of pixels, and the total movement distanceis represented as a relative value (ratio) based on a length of theangle of view A0 in the movement direction. The estimated time period towhen the moving extraction range A1 reaches the end of the angle of viewA0 is a required time period for movement of the extraction range A1 tothe end of the angle of view A0 and is obtained from the distance fromthe end of the extraction range A1 to the end of the angle of view A0,and the movement speed of the extraction range A1. The setting operationmethod for the extraction range A1 is information indicating whichdevice is to be operated in the operating part 50 in a case of setting a“certain content” related to the extraction range A1.

In addition, in a case where the extraction range A1 moves duringimaging, the displayed information IF (specifically, the position of theextraction range A1) such as the setting contents changes in connectionwith the movement. In addition, in a case where the size, the aspectratio, or the like of the extraction range A1 is changed duringmovement, the information IF such as the setting contents is updated inaccordance with the setting contents after change.

The information IF such as the setting contents is displayed on thedisplay device 40 together with the extraction video P1 and the supportvideo P2 by the video processing portion 32 during imaging. In the firstembodiment, as illustrated in FIG. 4 , the information IF such as thesetting contents is displayed at a position (for example, a rightadjacent position) adjacent to each of the extraction video P1 and thesupport video P2 in the lateral direction. However, the presentinvention is not limited thereto. For example, the information IF suchas the setting contents may be displayed at a position above or aposition below the extraction video P1 or a position above or a positionbelow the support video P2. In addition, a plurality of regions in whichthe information IF such as the setting contents is displayed may beprovided on the screen of the display device 40. Information related tothe reference video P0 may be displayed in one of the regions, andinformation related to the extraction video P1 may be displayed inanother region.

[Display Method]

Next, the display method using the imaging apparatus 10 will bedescribed with reference to FIGS. 11 and 12 . FIGS. 11 and 12 illustratea flow of display flow by the imaging apparatus 10. In the display flowillustrated in FIGS. 11 and 12 , a display method according to theembodiments of the present invention is employed. In other words, eachstep illustrated in FIGS. 11 and 12 corresponds to constituents of thedisplay method according to the embodiments of the present invention.Furthermore, in the display flow, the display method according to theembodiments of the present invention is employed, and a recording stepdescribed later is executed. That is, in the display flow, a videorecording method according to the embodiments of the present inventionis employed.

At a start of the display flow, the user starts the imaging apparatus10. After the start of the apparatus, the controller 30 executes asetting step (S001). In the setting step, the extraction range A1 is setwithin the angle of view A0 based on preset initial values or contentsof an instruction issued by the user.

Then, the controller 30 starts executing an imaging step by controllingthe imaging portion 20 (S002). The imaging step corresponds to anacquisition step of acquiring the reference video P0 that is a motionpicture. In the first embodiment, the imaging step is a step ofcapturing the reference video P0 within the angle of view A0 in a caseof using the anamorphic lens.

In a case where the imaging step is executed, the video processingportion 32 executes an extraction step under control of the controller30 (S003). In the extraction step, the video processing portion 32extracts a video of the extraction range A1 set in the setting step,that is, the extraction video P1, from the reference video P0.

The video processing portion 32 executes a first display step ofdisplaying the extraction video P1 on the display device 40 and a seconddisplay step of displaying the support video P2 on the display device 40in accordance with extraction of the extraction video P1 (S004). Here,the second display step is executed during execution of the firstdisplay step. Accordingly, the extraction video P1 and the support videoP2 are displayed on the display device 40 at the same time duringimaging.

In a case of capturing the reference video P0 using the anamorphic lensin the imaging step, in the first display step, the extraction video P1is displayed by extending the size in the lateral direction of the angleof view A0 in a case of using the anamorphic lens. In addition, in thefirst embodiment, in the first display step, the extraction video P1 isdisplayed in a state where the display size of the extraction video P1can be changed while the aspect ratio of the extraction video P1 isconstantly maintained.

In addition, in the second display step, the support video P2 in whichthe position of the extraction video P1 in the support video P2 isspecified, specifically, the support video P2 in which the part of theextraction video P1 is surrounded by a frame as illustrated in FIG. 9 ,is displayed. In a case where the display size of the extraction videoP1 is changed, in the second display step, the support video P2 isdisplayed in a state where a display size of the support video P2 ischanged in accordance with the change in display size of the extractionvideo P1. At this point, it is preferable that the support video P2 isdisplayed in a state where the display size is changed while the aspectratio of the support video P2 is constantly set.

Furthermore, in the first embodiment, a third display step of displayingthe information IF such as the setting contents on the display device 40is further executed during execution of both of the first display stepand the second display step. Accordingly, the extraction video P1, thesupport video P2, and the information IF such as the setting contentsare displayed on the display device 40 at the same time during imaging.

In a case where the user pushes the release button 310 after extractionof the extraction video P1 is started, execution of the recording stepis started based on the push as a trigger (S005). In the recording step,the extraction video P1 is recorded in the internal memory 230 or thememory card 240 as the recording medium by the video processing portion32. In the first embodiment, a recorded video is limited to only theextraction video P1. Other videos, that is, the reference video P0 andthe support video P2, are not recorded and are discarded. Accordingly, aused amount of a recording capacity can be further decreased. However,the present invention is not limited thereto. One or both of thereference video P0 and the support video P2 may be recorded togetherwith the extraction video P1.

In addition, in a case where the user issues an instruction to move theextraction range A1 within the angle of view A0 during execution of theimaging step (S006), a movement step is executed by the video processingportion 32 (S007). In the movement step, the extraction range A1 moveswithin the angle of view A0 along the movement path corresponding to themode selected by the user from the tracking mode and the panning mode.More specifically, in a case where the tracking mode is selected, theextraction range A1 is moved within the angle of view A0 such that thesubject of the tracking target set by the user enters within theextraction range A1. Meanwhile, in the movement step in a case where thepanning mode is selected, the extraction range A1 slides (pans) based onthe starting position, the movement direction, and the movement speedset by the user.

In a case where the movement step is executed, the video processingportion 32 executes the first display step, the second display step, andthe third display step in accordance with movement of the extractionrange A1 (S008). Specifically, in the first display step, the extractionvideo P1 during movement of the extraction range A1 is displayed. In thesecond display step, the support video P2 is displayed such that theposition of the extraction video P1 in the support video P2 changes. Inthe third display step, the information IF such as the setting contentsis updated and displayed in accordance with movement of the extractionrange A1. In step S008, in the same manner as in step S005, the seconddisplay step is executed during execution of the first display step, andthe third display step is executed during execution of both of the firstdisplay step and the second display step.

In addition, in a case where the movement step is executed, the videoprocessing portion 32 executes the recording step such that theextraction video P1 during movement of the extraction range A1 in themovement step is recorded (S009).

Meanwhile, in a case where the instruction of the user for movement ofthe extraction range A1 is not issued, execution of the first to thirddisplay steps and the recording step is repeated until an instruction tofinish imaging is issued by the user (S010), and the display flow isfinished at a point in time when the instruction to finish imaging isissued. At this point in time, imaging ends, and recording of theextraction video P1 is finished. An operation for issuing theinstruction to finish imaging by the user is not particularly limited.For example, an operation of pushing the release button 310 again may bethe instruction to finish imaging.

Returning to a processing flow in a case where the movement step isexecuted, in a case where the user issues an instruction to change atleast one of the position, the size, the movement speed or the movementdirection (hereinafter, referred to as the “position or the like of theextraction range A1”) of the extraction range A1 during execution of themovement step (S011), the controller 30 executes the setting step again(S012). In the setting step executed again, the position or the like ofthe extraction range A1 is set again based on the instruction of theuser received during execution of the movement step.

Then, a return is made to step S007, and each of the movement step, thefirst to third display steps, and the recording step is repeatedlyexecuted. In the movement step after the position or the like of theextraction range A1 is set again, at least one of the position or thelike of the extraction range A1 is changed based on the instruction ofthe user received during execution of the movement step, and then, theextraction range A1 is moved.

In addition, in the first to third display steps (that is, step S008)after the movement step, the extraction video P1, the support video P2,and the information IF such as the setting contents based on theextraction range A1 of which the position or the like is changed aredisplayed on the display device 40. Specifically, in the first displaystep, the extraction video P1 after the position or the like of theextraction range A1 is changed is displayed. In the second display step,the support video P2 in which the position of the extraction video P1 inthe support video P2 is a position after change is displayed. In thethird display step, the information IF such as the setting contents isupdated and displayed in accordance with the change in position or thelike of the extraction range A1.

In addition, in a case where the movement step is executed, the videoprocessing portion 32 appropriately executes a determination step(S013). The determination step is executed during execution of themovement step. In the determination step, a determination as to whetheror not the distance between the end of the angle of view A0 and the endof the extraction range A1 (in a strict sense, an end on a sideapproaching the end of the angle of view A0) is less than a thresholdvalue is performed.

In a case where a determination that the distance is less than thethreshold value is made in the determination step (S014), the videoprocessing portion 32 executes an alert step (S015) and issues an alertto the user. Accordingly, the user can be prompted to perform anoperation for changing the angle of view, the operation for issuing theinstruction to finish imaging, or the like by notifying the user thatthe extraction range A1 approaches near the end of the angle of view. Analert method in the alert step is not particularly limited. For example,examples of the alert method include displaying an alert message on thedisplay device 40 or changing an outer edge frame of the extractionvideo P1 to a predetermined color (specifically, red or the like).

In a case where the movement step is executed, the series of steps S007to S015 is repeated until the instruction to finish imaging is issued bythe user (S016), and the display flow is finished at a point in timewhen the instruction to finish imaging is issued. At this point in time,imaging ends, and recording of the extraction video P1 is finished.

As described above, in the video display method according to the firstembodiment, the extraction video P1 smaller than the angle of view A0can be extracted from the reference video P0, and the extraction rangeA1 can be moved within the angle of view A0. Furthermore, duringmovement of the extraction range A1, by displaying the extraction videoP1 on the display device 40, the user can check the extraction video P1.At this point, it is preferable that the position of the extractionrange A1 within the angle of view A0 can be perceived. Therefore, in thefirst embodiment, the support video P2 as an interface representing theposition of the extraction range A1 within the angle of view A0 isdisplayed on the display device 40 together with the extraction videoP1. Accordingly, even in a case where the extraction range A1 moveswithin the angle of view A0, the user can perceive the position of theextraction range A1 at each point in time during movement. Such aneffect is particularly effective in a case where the tracking mode isselected, and the extraction range A1 randomly moves to track apredetermined subject in accordance with a motion of the subject.

In addition, in the first embodiment, in a case where the instruction tochange issued by the user is received during execution of the movementstep, at least one of the position, the size, the movement speed or themovement direction of the extraction range A1 is changed based on theinstruction. In this case, the effect that the user can perceive theposition of the extraction range A1 is more remarkably exhibited.

In addition, in the first embodiment, the support video P2 includes theextraction video P1, and the support video P2 is displayed in a statewhere the position of the extraction video P1 in the support video P2 isspecified (for example, a state where the extraction video P1 issurrounded by a frame). Accordingly, the user can more easily perceivethe position of the extraction range A1.

In addition, in the first embodiment, information related to at leastone of the reference video P0 or the extraction video P1, that is, theinformation IF such as the setting contents, is displayed on the displaydevice 40 at the same time as the extraction video P1 and the supportvideo P2. Accordingly, the user can check various information indicatedby the information IF such as the setting contents and can be notifiedof more detailed information about the position of the extraction rangeA1 specified from the support video P2.

Second Embodiment

In the first embodiment, the support video P2 is configured with theentire reference video P0. In the second display step, the support videoP2 is displayed on the display device 40 in a state where the displaysize of the support video P2 can be changed. Alternatively, a form ofdisplaying a support video different from the support video P2 accordingto the first embodiment, for example, support videos P21 and P22illustrated in FIGS. 13 and 14 , may be considered. Hereinafter, thisform will be described as a second embodiment with reference to FIGS. 13to 15 . Here, FIGS. 13 and 14 illustrate screen examples of the displaydevice 40 in the second embodiment and correspond to FIG. 4 .

Hereinafter, items different from the first embodiment in the secondembodiment will be mainly described. In addition, the same elements asthe first embodiment among elements illustrated in FIGS. 13 and 14 willbe designated by the same reference numerals as in the first embodiment.

In the second embodiment, the user selects any one of two types ofdisplay schemes, and the support video is displayed on the displaydevice 40 using the selected display scheme. That is, the second displaystep in the second embodiment is executed in accordance with the displayscheme selected by the user from a first display scheme and a seconddisplay scheme. For the display scheme, a selection screen illustratedin FIG. 15 may be displayed on the display device 40, and the user mayselect the display scheme by, for example, touching one display schemeon the screen.

In a case where the first display scheme is selected, in the seconddisplay step, the support video P21 configured with the entire referencevideo P0 is displayed on the display device 40. An aspect ratio and adisplay size of the support video P21 can be changed.

In other words, in the second display step in a case where the firstdisplay scheme is selected, the support video P21 can be displayed in astate where the aspect ratio and the display size of the support videoP21 can be changed. For example, as illustrated in FIG. 13 , the supportvideo P21 of which the display size is reduced by squeezing the supportvideo P21 in a vertical direction can be displayed. Accordingly, in acase where the first display scheme is selected, a degree of freedom indisplay of the support video P21 is increased, compared to the firstembodiment. That is, in the second display step in a case where thefirst display scheme is employed, the support video P21 can be displayedin a state where the aspect ratio and the display size of the supportvideo P21 are changed in accordance with the change in display size ofthe extraction video P1. For example, in a case where a region in whichthe extraction video P1 is displayed on the display screen of thedisplay device 40 is increased, the aspect ratio and the display size ofthe support video P21 can be freely changed in accordance with an extraspace in order to display the support video P21 in the space.

In the second display step in a case where the second display scheme isselected, the support video P22 configured with a video of a part of thereference video P0 is displayed on the display device 40. The supportvideo P22 is displayed in a state where the display size can be changedwhile the aspect ratio is constantly maintained. That is, in the seconddisplay step in a case where the second display scheme is selected, thesupport video P22 can be displayed in a state where the display size ischanged while the aspect ratio is constantly maintained, in accordancewith the change in display size of the extraction video P1.

Furthermore, in a case where the second display scheme is selected, theuser can freely designate a range of the support video P22(specifically, a range displayed as the support video P22) in thereference video P0 and freely change the designated range by, forexample, operating the operating part 50. That is, in the second displaystep in a case where the second display scheme is selected, it ispossible to display the support video P22 while moving the range of thesupport video P22 in the reference video P0.

Examples of a method of designating the range of the support video P22in the reference video P0 include various methods such as a buttonoperation or a touch panel operation. In the second embodiment, a methodusing an auxiliary video Ps described later is used.

As described above, in a case where the second display scheme isselected, as illustrated in FIG. 14 , a video of the range designated bythe user in the reference video P0 can be set as the support video P22,and it is possible to change the display size of the support video P22while maintaining the aspect ratio of the support video P22. Forexample, in the reference video P0, only a necessary range necessary tobe displayed as the support video P22 is designated, and then, thedisplay size of the support video P22 is appropriately adjusted. Bydoing so, a display space of the support video P22 on the display device40 can be further decreased.

In addition, in a case where the second display scheme is selected, asillustrated in FIG. 14 , a range instruction video P3 that is a videoindicating the range of the support video P22 in the reference video P0is displayed on the display device 40 together with the extraction videoP1 and the support video P22. The range instruction video P3 isconfigured with the reference video P0 that is reduced, and theauxiliary video Ps displayed in a superimposed manner on the referencevideo P0. The auxiliary video Ps indicates a part of the reference videoP0 corresponding to the support video P22. The range of the supportvideo P22 in the reference video P0 can be perceived by visuallyrecognizing the auxiliary video Ps.

In addition, the user can move the auxiliary video Ps by, for example,performing a touch-and-drag operation on the screen. By moving theauxiliary video Ps, the range of the support video P22 in the referencevideo P0 can be changed.

In a case where the second display scheme is selected, a step(hereinafter, referred to as a fourth display step) of displaying therange instruction video P3 is executed in addition to the first to thirddisplay steps during execution of all of the first to third displaysteps. That is, in the second display scheme, all of the extractionvideo P1, the support video P22, the information IF such as the settingcontents, and the range instruction video P3 are displayed on thedisplay device 40 at the same time.

As described above, in a case where the second display scheme isselected, the user can freely decide the range of the support video P22by operating the auxiliary video Ps. In addition, by checking thesupport video P22 and the range instruction video P3, the position ofthe extraction range A1 within the angle of view A0 can be perceived.

In a case where the second display scheme is selected, displaying therange instruction video P3 (that is, executing the fourth display step)may not be necessary. The range instruction video P3 may not bedisplayed, and only the support video P22 may be displayed.

Third Embodiment

In the first embodiment, all of the extraction video P1, the supportvideo P2, and the information IF such as the setting contents aredisplayed on the same display device 40 of the imaging apparatus 10.Alternatively, a form of displaying the extraction video P1 and thesupport video P2 on display devices different from each other may beconsidered. Hereinafter, this form will be described as a thirdembodiment with reference to FIGS. 16 to 18 .

Hereinafter, items different from the first embodiment in the thirdembodiment will be mainly described. In addition, the same elements asthe first embodiment among elements illustrated in FIG. 16 will bedesignated by the same reference numerals as in the first embodiment.

The third embodiment relates to a display method using an imaging systemS illustrated in FIG. 16 . That is, the display method according to thethird embodiment of the present invention is implemented by the imagingsystem S. The imaging system S is configured with an imaging apparatus10X and an external monitor. As illustrated in FIG. 16 , a basicconfiguration of an imaging apparatus main body 12X according to thethird embodiment is approximately the same as the basic configuration ofthe imaging apparatus main body 12 according to the first embodiment.

Meanwhile, the imaging apparatus main body 12X according to the thirdembodiment comprises a first display device 410 configured with a touchpanel display or the like and is connected to a second display device420 that is the external monitor. The second display device 420 isconfigured with a display device such as a liquid crystal monitor, arecorder including a monitor, an information processing terminalincluding a monitor, such as a laptop personal computer, a smartphone,or a tablet terminal, or the like. The imaging apparatus 10X and thesecond display device 420 according to the third embodiment areconnected in a wired manner or a wireless manner.

In the third embodiment, a display device 400 that displays a videoincludes the first display device 410 and the second display device 420that are devices separated from each other. In addition, in the thirdembodiment, the video processing portion 32 of the imaging apparatustransmits video signals to each display device. Accordingly, asillustrated in FIG. 17 , the first display device 410 displays theextraction video P1, and the second display device 420 displays thesupport video P2.

In the third embodiment, a step (that is, the second display step) ofdisplaying the support video P2 on the second display device 420 isexecuted during execution of a step (that is, the first display step) ofdisplaying the extraction video P1 on the first display device 410.Consequently, even in the third embodiment, the user can more easilyperceive the position of the extraction range A1 within the angle ofview A0. A video corresponding to the display scheme selected by theuser from the two types of support videos P21 and P22 described in thesecond embodiment may be displayed on the second display device 420.

In addition, as illustrated in FIG. 17 , the information IF such as thesetting contents is displayed on the second display device 420 togetherwith the support video P2. Accordingly, in the third embodiment, a step(that is, the third display step) of displaying the information IF suchas the setting contents on the second display device 420 is comprised,and the third display step is executed during execution of both of thefirst display step and the second display step. A part of theinformation IF such as the setting contents, for example, the imagingconditions (for example, the exposure condition, the f number of thelens, the ISO sensitivity, and the white balance), may be displayed onthe first display device 410 as illustrated in FIG. 17 .

In addition, as illustrated in FIG. 16 , an orientation detector 60 ismounted in the imaging apparatus main body 12X according to the thirdembodiment. The orientation detector 60 is configured with, for example,an acceleration sensor. In a case where an orientation of the imagingapparatus 10X changes, for example, in a case where a width and a heightof the imaging apparatus 10X are inverted, the orientation detector 60detects the motion.

In the third embodiment, in a case where the user inverts the width andthe height of the imaging apparatus 10X during execution of the firstdisplay step, that is, during display of the extraction video P1 on thefirst display device 410, a width and a height of the first displaydevice 410 are inverted, and a display orientation of the extractionvideo P1 rotates by 90 degrees as illustrated in FIG. 18 . In a casewhere the orientation detector 60 detects this motion, the controller 30controls the video processing portion 32 in accordance with thedetection result. The video processing portion 32 generates the supportvideo P2 of which a width and a height are inverted from a state beforethe orientation detector 60 detects inversion of the width and theheight of the imaging apparatus 10X. The video processing portion 32transmits the video signals of the support video P2 to the seconddisplay device 420. Accordingly, in the second display step, the supportvideo P2 of which the width and the height are inverted as illustratedin FIG. 18 is displayed on the second display device 420. Accordingly,by changing a display orientation of the support video P2 in connectionwith the change in display orientation of the extraction video P1, theuser easily perceives a correspondence relationship between theextraction video P1 and the support video P2 even in a case where thewidth and the height of the first display device 410 are inverted.

Meanwhile, the information IF such as the setting contents is displayedon the second display device 420. However, as illustrated in FIG. 18 , adisplay orientation of the information IF such as the setting contentsdoes not change even after the orientation detector 60 detects inversionof the width and the height of the imaging apparatus 10X. That is, inthe third display step, the information IF such as the setting contentsis displayed on the second display device 420 in a state where thedisplay orientation is maintained before and after inversion of thewidth and the height of the first display device 410. Accordingly, evenin a case where the display orientation of the extraction video P1 isinverted between the width and the height, the information IF such asthe setting contents that are text information is displayed in a normalorientation. Thus, the user easily checks the information IF such as thesetting contents.

Fourth Embodiment

In the first to third embodiments, the video is a motion picture. Here,the motion picture means a collection of a plurality of images (frameimages) consecutively captured at a constant frame rate. In the first tothird embodiments, the extraction video recorded on the recording mediumis a motion picture. Alternatively, the extraction video recorded on therecording medium may be a still picture.

For example, the control portion including the controller 30 and thevideo processing portion 32 sets a still picture acquired in theacquisition step (specifically, the imaging step) as the reference videoP0. As illustrated in FIGS. 4 and 5 , the control portion displays thestill picture that is the reference video P0 on the display device 40 asthe support video P2. In addition, the control portion sets theextraction range A1 corresponding to the subject in the reference videoP0 and displays the extraction video P1 captured within the extractionrange A1 on the display device 40. In a case where the user executes therecording step by issuing an instruction to perform recordingprocessing, the control portion may execute recording of the stillpicture instead of capturing the motion picture and record theextraction video P1 that is the still picture on the recording mediumsuch as the memory card 240.

Other Embodiments

While specific embodiments (first to fourth embodiments) of the displaymethod according to the embodiments of the present invention areillustratively described so far, the embodiments are merely an example,and other embodiments are considered.

For example, in the embodiments, the third display step of displayingthe information IF such as the setting contents is executed duringdisplay of the extraction video P1 and the support video P2 (in otherwords, during execution of both of the first display step and the seconddisplay step). However, the present invention is not limited thereto.The information IF such as the setting contents may not be displayed bynot executing the third display step.

In addition, in the embodiments, as the acquisition step of the video,the imaging step of capturing the reference video using the imagingapparatus is executed, and the extraction video smaller than the angleof view of the imaging apparatus is extracted from the capturedreference video. However, the present invention is not limited thereto.For example, the acquisition step of the video may be a step ofacquiring a video for motion picture editing from an outside as thereference video. Specifically, the reference video may be acquired bydownloading a motion picture file of the reference video from anexternal data distribution apparatus (server). Alternatively, thereference video may be acquired by reading out a video of an editingtarget from a recording medium on which the motion picture file isrecorded.

In addition, in the embodiments, while a digital camera is illustratedas an example of the imaging apparatus, the present invention is notlimited thereto. For example, a portable terminal such as a mobile phoneincluding an imaging optical system, a smartphone, and a tablet PC maybe used. In addition, the anamorphic lens may be a lens unit externallyattached to the imaging optical system of the portable terminal.

EXPLANATION OF REFERENCES

-   -   10, 10X: imaging apparatus    -   12, 12X: imaging apparatus main body    -   14: housing    -   20: imaging portion    -   30: controller    -   32: video processing portion    -   40: display device    -   50: operating part    -   60: orientation detector    -   110: lens unit    -   112: zoom lens    -   114: focus lens    -   120: lens drive portion    -   130: stop portion    -   140: shutter    -   150: imaging sensor    -   160: A/D converter    -   230: internal memory    -   240: memory card    -   250: buffer    -   260: card slot    -   310: release button    -   320: zoom lever    -   330: front operation dial    -   340: rear operation dial    -   350: cross button    -   360: touch wheel    -   400: display device    -   410: first display device    -   420: second display device    -   A0: angle of view    -   A1: extraction range    -   IF: information such as setting contents    -   P0: reference video    -   P1: extraction video    -   P2, P21, P22: support video    -   P3: range instruction video    -   Ps: auxiliary video    -   S: imaging system

What is claimed is:
 1. A display method comprising: an acquisition stepof acquiring a reference video; an extraction step of extracting anextraction video set to be smaller than an angle of view of thereference video within the angle of view from the reference video; amovement step of moving an extraction range of the extraction video overtime; a first display step of displaying the extraction video on adisplay device; and a second display step of displaying a support videobased on a positional relationship between the angle of view and theextraction range on the display device, wherein the second display stepis executed during execution of the first display step, the displaydevice includes a first display device and a second display device, thefirst display device displays the extraction video on the first displaydevice, the second display device displays the support video on thesecond display device, the display method further comprises a thirddisplay step of displaying text information related to at least one ofthe reference video or the extraction video on the second displaydevice, the third display step is executed during execution of both ofthe first display step and the second display step, and in a case wherea width and a height of the first display device are inverted during thefirst display step, the support video of which a width and a height areinverted is displayed on the second display device in the second displaystep, and the text information of which a display orientation ismaintained is displayed on the second display device in the thirddisplay step.
 2. The display method according to claim 1, wherein thesupport video includes the extraction video, and in the second displaystep, the support video in which a position of the extraction video inthe support video is specified is displayed.
 3. The display methodaccording to claim 1, further comprising: a third display step ofdisplaying information related to at least one of the reference video orthe extraction video on the display device, wherein the third displaystep is executed during execution of both of the first display step andthe second display step.
 4. The display method according to claim 1,wherein in the first display step, the extraction video is displayed ina state where a display size of the extraction video is changeable, andin the second display step, the support video is displayed in a statewhere an aspect ratio of the support video and a display size of thesupport video are changeable.
 5. The display method according to claim4, wherein in the first display step, the extraction video is displayedin a state where the display size of the extraction video is changeablewhile an aspect ratio of the extraction video is constantly maintained,and in the second display step, the support video is displayed in astate where the display size of the support video is changed inaccordance with a change in display size of the extraction video.
 6. Thedisplay method according to claim 4, wherein in the second display step,the support video indicating a video of a part of the reference video isdisplayed in a state where the display size of the support video ischanged while the aspect ratio of the support video is constantlymaintained, in accordance with a change in display size of theextraction video.
 7. The display method according to claim 1, whereinthe second display step is executed in accordance with a display schemeselected by a user from a first display scheme and a second displayscheme, in a case where the first display scheme is selected, in thesecond display step, the support video is displayed in a state where anaspect ratio of the support video and a display size of the supportvideo are changeable, and in a case where the second display scheme isselected, in the second display step, the support video indicating avideo of a part of the reference video is displayed in a state where thedisplay size of the support video is changeable while the aspect ratioof the support video is constantly maintained.
 8. The display methodaccording to claim 1, wherein the acquisition step is an imaging step ofcapturing the reference video within the angle of view.
 9. The displaymethod according to claim 8, wherein in the imaging step, the referencevideo is captured within the angle of view using an anamorphic lens, andin the first display step, the extraction video is displayed byextending a size in a lateral direction of the angle of view using theanamorphic lens.
 10. The display method according to claim 8, whereinthe movement step is executed during execution of the imaging step, andin the movement step, at least one of a position, a size, a movementspeed, or a movement direction of the extraction range is changed basedon an instruction of a user received during execution of the movementstep.
 11. The display method according to claim 1, wherein in themovement step, the extraction range is moved within the angle of viewsuch that a subject of a tracking target set by a user enters within theextraction range.
 12. The display method according to claim 1, furthercomprising: a determination step of determining whether or not adistance between an end of the angle of view and an end of theextraction range is less than a threshold value during execution of themovement step; and an alert step of issuing an alert to a user in a casewhere the distance is less than the threshold value.
 13. A videorecording method employing the display method according to claim 1, thevideo recording method comprising: a recording step of recording theextraction video on a recording medium.
 14. The display method accordingto claim 2, further comprising: a third display step of displayinginformation related to at least one of the reference video or theextraction video on the display device, wherein the third display stepis executed during execution of both of the first display step and thesecond display step.
 15. The display method according to claim 2,wherein in the first display step, the extraction video is displayed ina state where a display size of the extraction video is changeable, andin the second display step, the support video is displayed in a statewhere an aspect ratio of the support video and a display size of thesupport video are changeable.
 16. The display method according to claim15, wherein in the first display step, the extraction video is displayedin a state where the display size of the extraction video is changeablewhile an aspect ratio of the extraction video is constantly maintained,and in the second display step, the support video is displayed in astate where the display size of the support video is changed inaccordance with a change in display size of the extraction video. 17.The display method according to claim 15, wherein in the second displaystep, the support video indicating a video of a part of the referencevideo is displayed in a state where the display size of the supportvideo is changed while the aspect ratio of the support video isconstantly maintained, in accordance with a change in display size ofthe extraction video.
 18. The display method according to claim 2,wherein the second display step is executed in accordance with a displayscheme selected by a user from a first display scheme and a seconddisplay scheme, in a case where the first display scheme is selected, inthe second display step, the support video is displayed in a state wherean aspect ratio of the support video and a display size of the supportvideo are changeable, and in a case where the second display scheme isselected, in the second display step, the support video indicating avideo of a part of the reference video is displayed in a state where thedisplay size of the support video is changeable while the aspect ratioof the support video is constantly maintained.
 19. The display methodaccording to claim 2, wherein the acquisition step is an imaging step ofcapturing the reference video within the angle of view.
 20. The displaymethod according to claim 19, wherein in the imaging step, the referencevideo is captured within the angle of view using an anamorphic lens, andin the first display step, the extraction video is displayed byextending a size in a lateral direction of the angle of view using theanamorphic lens.